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Abstract. - A self-organising model is proposed to explain the criticality in cortical networks de- 
duced from recent observations of neuronal avalanches. Prevailing understanding of self-organised 
criticality (SOC) dictates that conservation of energy is essential to its emergence. Neuronal 
networks however are inherently non-conservative as demonstrated by microelectrode recordings. 
The model presented here shows that SOC can arise in non-conservative systems as well, if driven 
internally. Evidence suggests that synaptic background activity provides the internal drive for 
non- conservative cortical networks to achieve and maintain a critical state. SOC is robust to 
any degree rj € (0, 1] of background activity when the network size N is large enough such that 
■qN ~ 10 3 . For small networks, a strong background leads to epileptiform activity, consistent with 
neurophysiological knowledge about epilepsy. 
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Neuronal networks have been demonstrated to exhibit 
a type of activity dubbed as "neuronal avalanche" [1]. A 
neuronal avalanche is characterised by a cascade of bursts 
of local field potentials (LFP), which originate from syn- 
chronised action potentials triggered by a single neuron. 
The intensity of the recorded LFP is assumed to be pro- 
portional to the number of neurons synchronously firing 
action potentials within a short time interval, and thus is 
a good measure of neuronal avalanche size [1] . The LFP 
bursts are brief compared to the observation period, typi- 
cally lasting tens of milliseconds and separated by periods 
of quiescence that last several seconds. When observed 
with a multielectrode array, the number of electrodes de- 
tecting LFPs, which is in turn proportional to LFP inten- 
sity, is distributed approximately as an inverse power law 
with exponent 1.5. The observed power law has been 
intuitively linked to the principles of self-organised critical- 
ity [1] through results from the study of critical branching 
processes [2], and has been proposed and modelled [3,4] to 
consequently enhance the information processing capabil- 
ity of cortical networks in vivo. It has been experimentally 
demonstrated however that propagation of neural activity 
does not conserve information content, which is encoded 
in the frequency of spike firing [5] . This experiment sus- 
tains previous findings that synaptically connected pairs of 
neurons exhibit information transmission failures wherein 
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action potentials from the pre-synaptic neuron do not de- 
polarise the post-synaptic neuron [6]. Information loss 
during transmission seems to preclude the observed neural 
synchrony in neuronal networks through avalanche activ- 
ity. Moreover, the critical branching process model con- 
cludes that any degree of loss or non-conservation frus- 
trates criticality and introduces a characteristic size to the 
avalanche size distribution [7]. Thus until now a gap ex- 
ists between experiment and theory in terms of explaining 
how cortical networks maintain criticality despite inherent 
non-conservation in neuronal transmission. 

Neurons receive and transmit information using one 
form of medium — the electric potential, which is both re- 
ceived as input (synaptic potential) and fired as output 
(action potential or local field potential). Each neuron 
stores the input as membrane potential and when this ex- 
ceeds a threshold the neuron fires. Usage of one form of 
medium in receiving, storing and transmitting informa- 
tion, as well as the all-or-none response of neurons par- 
allels with that of SOC sandpile models. A "sand grain" 
serves as the currency of exchange and a sandpile site only 
transfers grains when the amount of stored grains exceeds 
a particular threshold. Thus, neuronal avalanches may 
parsimoniously, yet sufficiently, be analysed using SOC 
sandpile models. 

The large number of neurons and the high density of 
non-local synaptic connections (i.e., linking neurons dis- 
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tally located from each other) that comprise the brain [8] 
allows the approximation of the physics underlying its 
information transport by mean-field models. A conve- 
nient mean-field sandpile model that appropriately cap- 
tures neuronal avalanche dynamics is the self-organised 
critical branching process (SOBP) model introduced by 
Zappcri, Lauritsen and Stanley [2], which represents the 
avalanche as a branching process. SOC in this model is 
closely connected with the criticality of the branching pro- 
cess for which the theory is well-established [9]. In the 
branching process theoretical framework, activity at one 
site generates subsequent activity in a number of other 
sites. When the number of subsequently activated sites — 
the branching parameter a — is equal to unity on the av- 
erage, the branching process is critical. Criticality in the 
SOBP model has been achieved only when grain transfer 
during an avalanche is conservative. This has been proven 
by incorporating into the model a probability e that grains 
which dislodge from a toppling activated site is absorbed 
(or dissipated) rather than exchanged. For any e > 0, the 
branching parameter a < 1, and a characteristic size in 
the avalanche size distribution, which scales with e~ 2 , is 
introduced. Avalanches are not sustained when the con- 
servation law is violated; they easily die out after a few 
topplings. The characteristic size diverges when e — > 0, or 
when the SOBP system is conservative [7]. Thus, repre- 
sentation of neuronal avalanches, which display criticality 
while occurring in a non-conservative substrate, through 
the SOBP model seems to be a contradiction [10]. 

A plausible source of sustaining the drive to neuronal 
avalanches is synaptic background activity [11], which has 
been found to enhance responsiveness of neocortical pyra- 
midal neurons to sub-threshold inputs. Synaptic back- 
ground activity occurs in the form of membrane potential 
fluctuations. Because of these voltage fluctuations, small 
excitatory inputs are able to generate action potentials in 
neurons. The enhancement of weak signal detection capa- 
bility in the presence of background activity is analogous 
to a well-studied nonlinear phenomenon in physics known 
as stochastic resonance. It has been suggested that the 
level of background activity within actual in vivo corti- 
cal networks is optimal and possibly keeps neurons in a 
highly responsive state [11]. In this Letter, a phenomeno- 
logical model of synaptic background activity is incorpo- 
rated into the SOBP model to realise SOC in the presence 
of a violation of the transmission conservation law. The 
non-conservative SOC model proposed here parallels the 
theoretical work of Pruessner and Jensen on a sandpile- like 
model defined to approach the random-neighbour forest- 
fire model in the non-conservative limit [12]. 

A crucial starting point for describing the model is 
translating the sandpile language into terms that define 
neuronal phenomena, done in the following. A site cor- 
responds to a neuron, and its height is analogous to the 
membrane potential. At "rest," the membrane potential 
is typically -90 mV < V m < -40 mV [8]. A neuron can 
undergo a critical state determined by a threshold poten- 



tial which is less negative than the resting potential, but 
varies across different types of neurons. When the mem- 
brane potential crosses this threshold, an action potential 
is initiated. These three neuronal states are mapped to 
sandpile height z in the following manner: z = (resting 
state); z — 1 (critical state); and z = 2 (excited state). 
Neurons only fire action potentials when they are in the 
excited state. These mappings also agree with the defi- 
nition of the Manna sandpile [13]. Lastly, grain addition 
and subtraction operations in sandpile models correspond 
to depolarisation and hyperpolarisation, respectively. De- 
polarisation displaces the membrane potential of a neuron 
towards a less negative value, while hyperpolarisation dis- 
places the membrane potential towards a more negative 
value [8]. In the model, depolarisation corresponds to a 
change Az = +1 in the membrane potential whereas hy- 
perpolarisation to a change Az = —1 or —2. Albeit the 
actual values of V m are continuous, the discretisation em- 
ployed here is sufficient to emulate the crucial role played 
by the threshold potential to neuronal activation. 

The model cortical network is assumed to be a fully- 
connected random network in order to simplify the mean- 
field treatment. Although fully-connected, only two 
randomly-chosen synaptic connections of a neuron are po- 
tentially utilised in every avalanche event. The network 
has a size of N = 2 n+1 — 1 neurons, where n is the upper 
bound on the number of depolarisations (caused by action 
potentials triggered by a single neuron) that can take place 
in a single avalanche. This serves as the boundary condi- 
tion to a mean- field model that neglects spatial details [2] . 
The network is in a "quiescent" state when no excited neu- 
rons are present; otherwise it is "activated." The densities 
of critical neurons and resting neurons in a quiescent net- 
work are p and 1 — p, respectively. The network is slowly 
stimulated by external stimuli. The probability that the 
stimulus excites a critical neuron simply corresponds to 
the density p. At this point, the network is activated and 
avalanche ensues. The excited neuron fires an action po- 
tential that is transmitted to two post-synaptic neurons, 
chosen at random. Three different things may happen: (i) 
with probability a the excited neuron hyperpolarises to 
resting state (z : 2 — > 0) and both post-synaptic neurons 
depolarise; (ii) with probability (3 the excited neuron hy- 
perpolarises to critical state (z : 2 — > 1) and only one of 
the two post-synaptic neurons depolarises; and (iii) with 
probability e = 1 — a — (3 the excited neuron hyperpolarises 
to resting state (z : 2 — > 0) but the action potential fails to 
transmit thereby none of the post-synaptic neurons depo- 
larise. These rules are applied iteratively for every excited 
neuron that emerges until the whole network recovers its 
quiescent state or when the action potential propagates 
a total of n steps, after which no subsequent depolarisa- 
tion takes place. The n-th neuron, which serves as the 
boundary of avalanche propagation, may loosely be inter- 
preted as a peripheral or a motor neuron. In the wake 
of an avalanche, the density p of the quiescent network 
changes. Avalanches take place instantaneously with re- 
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spect to the period that the network lingers in the qui- 
escent state. This timescale separation is also observed 
experimentally [1], and is evident in the fast processing 
time of the brain when presented with a sensory stimu- 
lus [8]. 

Treating the neuronal avalanche as a branching process 
allows us to define a branching probability 

TTk = ap5 ki2 + 0pS k ,i + [1 - (1 - e)p] 5 k ,o , (1) 

where k denotes the number of post-synaptic neurons that 
get depolarised by the action potential released by an ex- 
cited neuron. The first term of Eq. (1) represents case 
(i), the second term represents case (ii), and the last term 
is the sum of the probability described in case (iii) and 
the probability (1 — p) that the neuron subsequently de- 
polarised is a resting neuron, which also yields no action 
potential. Having e > (or equivalently a + /3 < 1) makes 
the sandpile model violate the transmission conservation 
law. A branching parameter a = (2a + (3) p is calculated 
from Eq. (1) according to the definition a — ^2 k kirk [9]. 
The branching process is sub-critical if a < 1, whereby an 
avalanche typically dies out after a few (< n) transmis- 
sion steps. The branching process, on the other hand, is 
supra-critical if a > 1, describing an avalanche that perco- 
lates the entire network with nonzero probability. At the 
critical value a = 1, the avalanche size distribution P(s) 
is calculated using a generating function directly derivable 
from Eq. (1): 
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where a = /3 2 p 2 — Aap [1 — (1 — e)p] and b = [3p, and is 
related to P(s) as a complex-variable power series 
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Taking N — > oo, expansion of Eq. (2) about the singu- 
larity uj — followed by the comparison of terms to the 
coefficients of Eq. (3) results to a recurrence relation of 
P(s) valid for s > 2: 

_ bP( S -l)(2 S -l)-aP( S -2)( S -2) 

n*)- 8 + 1 > w 

and subject to the end conditions: P(0) = and P(l) = 
(b 2 — a) /4a. At the critical state, a = 2b— 1 or equivalently, 
the function 

Q(p) = (3 2 p 2 - 4ap [1 - (1 - e)p] -2(3p+l (5) 

is equal to zero, which follows from a = 1. Eq. (4) asymp- 
totically approaches power-law behaviour with exponent 
3/2 for s » 1, which can be shown graphically. A closed 
form solution for Eq. (4) can also be easily solved by set- 
ting /3 = [14]. 



The phenomcnological model for synaptic background 
activity is conceived by assuming the presence of sub- 
threshold membrane potential fluctuations in neurons 
when the network is in the quiescent state. The back- 
ground activity level is quantified by a parameter r/ e 
(0,1]. A resting neuron depolarises with probability r\ 
to become critical (z : — > 1); otherwise it remains in 
the resting state. Parallel update of all neurons through 
this process contributes a change 77(1 — p) to the density 
p of critical neurons. This process represents the stochas- 
tic fluctuations arising from excitatory post-synaptic po- 
tentials (EPSPs) on the membrane potential [8]. On the 
other hand, a critical neuron hyperpolarises to resting 
state (z : 1 — > 0) with probability 77 multiplied by the de- 
viation of the branching parameter per critical neuron a j p 
from unity. Parallel update over all neurons through this 
process contributes a change —r\(ajp — l)p to the density 
p, and represents the stochastic fluctuations arising from 
inhibitory post-synaptic potentials (IPSPs) on the mem- 
brane potential [8] and the feedback mechanism to sup- 
press runaway excitation [15]. Both effects of EPSPs and 
IPSPs operate on the same timescale and can be conve- 
niently added together to give a net change r = 77(1 — a) to 
the density p of critical neurons in the quiescent network. 
T is dominantly excitatory to the network when a < 1, 
which effectively increases p; on the other hand, it is dom- 
inantly inhibitory when a > 1, which effectively decreases 
p. Experimental evidence shows that this type of see- 
saw between cortical excitation and inhibition is a form of 
synaptic plasticity that contributes in stabilising cortical 
networks, keeping them on the border between inactivity 
and epileptiform activity [6]. The parameter r\ takes on a 
more physical meaning because experiments reveal an in- 
ternal mechanism for differential synaptic depression that 
dynamically adjusts the balance between cortical excita- 
tion and inhibition to foster cortical network stability [15]. 

Summing the changes in p brought about by synaptic 
background activity T and the neuronal avalanche lays out 
the following dynamical equation 



^= v [l-a(p)}+A(p) + ^ 



(6) 



The first term is T and the second term represents the 
change in p in the wake of a neuronal avalanche, 
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which is derived by following closely the branching pro- 
cess arguments of the analysis in [7] . The last term in (6) 
represents the fluctuations, which properly vanish in the 
limit of large N, around average quantities assumed in 
the calculation of T and A. This noise term is therefore 
neglected in the mean-field approximation for large N. 
The first term inside {•} of (7) represents the depolarisa- 
tion caused by external stimuli that consequently brings a 
critical neuron to excited state and initiate an action po- 
tential. The second term represents the average amount of 
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action potential dissipated by the n-th neuron. The third 
term is present when e > and represents the average 
amount of action potential absorbed due to transmission 
failure. Hence, e is the degree of non-conservation in the 
cortical network. 

The stationary behaviour of Eq. (6) is analysed in phase 
space. Fig. 1 plots the phase portraits of p for different 
network sizes N. All networks have the same degree of 
non-conservation and background intensity e = 0.25 and 
r\ = 0.0625, respectively. The fixed points p* are the roots 
of the phase portraits. Also shown is the function Q(p) 
defined in Eq. (5) with a unique root at p c — 2/3. As 
N increases, p* — > p c . However, even for a network as 
small as N = 131071 neurons, \p* - p c \ « 1. The rapid 
convergence of p* to p c from N = 31 to N = 131071 and 
the diminishingly perceptible difference between the phase 
portraits from N = 131071 to N — > oo indicate a phase 
transition. 
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Fig. 1: Phase portrait of the density p of critical neurons for a 
network with degree of non-conservation e = 0.25 driven by a 
background with n = 0.03125 at different sizes N: (A) N = 31, 
dotted curve; (B) N = 511, chain curve; (C) N = 131071, 
dashed curve; and (D) N — » oo, full curve. Also plotted is the 
function Q(p) with root at p c = §■ 

Indeed, as shown in Fig. 2, a transition from sub-critical 
phase (p* < p c ) to critical phase (p* — p c ) occurs. Data 
collapse reveals that the profile of the phase transition 
docs not depend on r\ and N separately, but rather on 
the product r/N. In the sub-critical phase, the quiescent 
network has p — \ of critical neurons, in accordance with 
the results of [7]. But starting at r]N ~ 10~ 1 , the network 
driven by a background activity abruptly transforms to 
a critical phase up to rj N < 10 3 . The critical phase is 
characterised by p = p c = (2a + /3) _1 (or p c = [2(1 — e)] _1 
for (3 = 0) for which the branching parameter a = 1. 
Starting at r/N ~ 10 3 , the network is in the critical phase 
for any degree of non-conservation e £ (0, 0.5] (at e > 0.5, 
the critical density p c > 1, hence impossible to achieve). 
The phase transition implies that if the network is very 



large (~ 10 12 neurons), which is typical of actual cortical 
networks [8] , then a wide range of r\ enables the network to 
maintain its critical phase, as long as r/N > 10 3 . However, 
since the fluctuations £/N are neglected in analysing the 
stationary behaviour of Eq. (6), this conclusion does not 
necessarily hold true for networks with intermediate sizes, 
for which the fluctuations may not be negligible. Thus, 
simulation results are essential in probing the stationary 
behaviour of the network for this case. 
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Fig. 2: Fixed point p* versus r/N exhibiting data collapse for 
networks of varying sizes with two different degrees of non- 
conservation: (A) e = 0.45, p c = 0.909, filled polygons; and 
(B) e = 0.25, p c = 0.667, open polygons. Transition occurs 
between sub-critical phase (p* < p c ) and critical phase (p* = 
p c ). Phases are separated by a solid line footed at r/N ~ 10 3 . 

A simulation of the model is performed for a network 
with size N = 131071 driven by a synaptic background 
with -q = 0.025 such that f]N 3670. The degree of 
non-conservation in the simulated network is e = 0.25 
such that the critical density p c = 0.8, in accord with the 
findings of Vogels and Abbott that depolarisations due to 
synchronous action potentials evoke post-synaptic spikes 
only 80% of the times [5]. After rescaling the simulated 
avalanche size with a factor deduced from data in [1], the 
simulated network successfully fits the experimental data 
for the neuronal avalanche distribution adopted from [3], 
as shown in Fig. 3 (Top panel). A power-law with ex- 
ponent 3/2 mainly characterises the distribution. How- 
ever, an exponential cutoff appears because of the limited 
number of microelectrodes used to resolve LFP intensity 
during the experiments [1] . The cutoff shifts to the right 
(i.e., towards larger avalanche sizes) when the number of 
microelectrodes is increased. The simulation data also fits 
this exponential tail, which also arises from the boundary 
condition that effectively puts an upper bound n to the 
number of transmission steps during an avalanche. The 
cutoff also shifts to the right by increasing n. Hence, both 
model and experimental data agree not only in the power- 
law behaviour of the avalanche size distribution, but also 
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in the mechanism that gives rise to the exponential tail. 
The inset graph illustrates the evolution of the density p 
in the quiescent network with time t, approaching the crit- 
ical value p c = 0.8 in the steady state. This steady-state 
behaviour is supported by a phase plot of p (Fig. 3, Bot- 
tom panel). The fixed point (B) corresponds to p c = 0.8. 
Also shown are two other dynamical attractors (A, C), 
which correspond to background activity fluctuations ne- 
glected in the fixed-point analysis of Eq. 6. The symmetry 
between (A) and (C) evidently suggests the balance of cor- 
tical excitation and inhibition, imparting stability to the 
network at the critical state. Thus, the background activ- 
ity is essential in maintaining the network at the critical 
state such that a power-law avalanche size distribution is 
generated. 

Actual neuronal networks are found to be redundant — 
several identical neurons that perform similar roles are 
present [8]. Redundancy thereby enlarges the network, 
and may be vital to its robustness. Through the model, 
robustness of the critical behaviour due to network size 
is explored by driving a small (N = 131071) and a 
large (N = 4194303) network with a strong background 
(t] = 1.0). Fig. 4 (Left panel) shows a small network driven 
by strong background exhibiting an asymmetry in the ex- 
citatory and inhibitory dynamical attractors — there is a 
larger region of excitation than inhibition. This mecha- 
nism is believed to be the precursor of epileptic seizures, 
which manifests in the synchronous firing of a large num- 
ber of neurons. The inset graph illustrates the avalanche 
size distribution for this network. A marked peak appears 
(indicated by arrow) for large avalanche sizes of the dis- 
tribution. Hence, there is a high probability for a large 
number of neurons to synchronously depolarise and fire 
action potentials. This feature indicates that small net- 
works show epileptiform activity when driven by a strong 
background. This is consistent with neurophysiological 
knowledge that seizure development is triggered by dam- 
ages to brain cells caused by injury, drug abuse, degenera- 
tive neurodiseases, brain tumors, and brain infections [8]. 
On the other hand, the large network is robust to strong 
background activity (Fig. 4, Right panel). The avalanche 
size distribution of this network (inset graph) exhibits the 
expected power-law behaviour and there is no pronounced 
peak for large avalanche sizes. 

Summary and Conclusion. — A self-organising mecha- 
nism for neuronal avalanche activity is proposed. Criti- 
cality manifests in the power-law behaviour of neuronal 
avalanche sizes. Despite an inherent transmission non- 
conservation in neuronal networks, this criticality is main- 
tained. A large neuronal network that is internally driven 
by synaptic background activity self-organises towards 
and robustly maintains a critical state for any level of 
background activity r\ g (0, 1] and for any degree of non- 
conservation e G (0,0.5]. This finding advocates the role 
of redundancy of neuronal networks in fostering robust- 
ness against any fluctuations of internal activity. A small 
neuronal network, on the other hand, loses the balance 
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Fig. 3: Top panel. — Distribution of neuronal avalanche size 
data adopted from [3] (circles), and of a simulated net- 
work (full-curve) with r/N fa 3670 having a degree of non- 
conservation e — 0.25. Inset graph shows p versus iterations 
t approaching a critical value p c = 0.8 in the steady state. 
Bottom panel. — Phase plot of the simulated network, starting 
at p — 0, converging towards three dynamical attractors: (A) 
excitatory background fluctuations; (B) fixed point (p* = p c ); 
and (C) inhibitory background fluctuations. The solid line is 
the mean-field prediction. 

between cortical excitation and inhibition when driven by 
a strong background (77 = 1.0), consequently leading to 
epileptiform activity. This finding agrees with neurophys- 
iological knowledge that brain cell damage is a chief con- 
tributor to the onset of seizure development. 

The model also proves that self-organised criticality can 
be achieved even when a conservation law of dynamical 
transfer is violated. A transition occurs from a sub-critical 
to a critical phase, demonstrating a vast regime for non- 
conservative systems to display SOC behaviour. Thus, it 
addresses a long-standing issue that is fundamental to the 
theory of self-organised criticality — whether conservation 
is necessary for its emergence. 

Recommendations. — A key assumption in the model is 
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Fig. 4: Phase plots for two networks of different sizes N but 
similar degrees of non-conservation e = 0.25 and driven by a 
strong background rj = 1.0. Critical density is at p c — 0.8. 
Left panel. — N = 131071 neurons, showing a prominent pro- 
trusion at p > p c and p > 0. Solid line is the mean-field pre- 
diction. Inset graph displays the logarithmically-binned dis- 
tribution of avalanche sizes with a marked peak (pointed by 
arrow) for large sizes, indicating epileptiform activity. Right 
panel. — N = 4194303 neurons, showing stability of the fixed 
point at p c consistent with mean-field prediction (solid line). 
Inset graph displays the logarithmically-binned distribution of 
avalanche sizes exhibiting considerable power-law behaviour. 

network randomness. However, the morphology of ac- 
tual neuronal networks may actually be more accurately 
characterised in terms of small-world connectivity pat- 
terns [16-18]. Thus, an investigation into the behaviour 
of the model in small-world networks is recommended as 
a possible extension of this study. Nevertheless, the main 
conclusions, which do not strongly depend on the network 
morphology as long as the density of connections and the 
size of the network remain large, would still hold. 
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